The Annals of Probability 
2009, Vol. 37, No. 2, 676-686 
DOI: 10.1214/08-AOP416 

© Institute of Mathematical Statistics, 2009 

TRANSCIENCE/RECURRENCE FOR NORMALLY REFLECTED 
BROWNIAN MOTION IN UNBOUNDED DOMAINS 

By Ross G. Pinsky 

Technion — Israel Institute of Technology 

Let D C be an unbounded domain and let B{t) be a Brownian 
motion in D with normal reflection at the boundary. We study the 
transcience/recurrence dichotomy, focusing mainly on domains of the 
form D = {{x, z) £ 7i'+™ : [z| < H{\x\)}, where d = Z + m and is a 
sufficiently regular function. This class of domains includes various 
horn-shaped domains and generalized slab domains. 

1. Introduction and statement of results. Let D C be an unbounded 
domain with C^-boundary and consider Brownian motion {^B{t),Q <t < oo} 
in D with normal reflection at the boundary [4]. The normally reflected 
Brownian motion is a reversible Markov process with self-adjoint generator 
^Atv, where A^v is the Neumann Laplacian on D. In this paper we study 
the transience/recurrence dichotomy for this process. 

We recall the following facts which can be found in [3]. For a bounded 
open set U C D, let tjj = inf {t >0:B(t)£tJ} denote the first hitting time of 
U, the closure of U. Let Py and Ey denote probabilities and expectations for 
the normally reflected Brownian motion starting from y ^ D. One has either 
Pyiw < co) = 1, for all y ^ U and all bounded open U for which D — U 
is connected, or else, one has Py{Tu < oo) < 1, for all such y and U. In the 
former case, the process is recurrent and in the latter case it is transient and 
one has limj^oo = oo a.s. In the recurrent case, the process is called 

positive recurrent or null recurrent, respectively, according to whether it 
does or does not possess an invariant probability measure. One has either 
EyTu < OO, for all y and U as above, or else one has EyTu = oo, for all such 
y and U. The former case is equivalent to positive recurrence. 
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The power of self-adjointness renders disarmingly simple the character- 
ization of positive recurrence for the normally reflected Brownian motion: 

Proposition 1. The normally reflected Brownian motion in D C is 
positive recurrent if and only ifYol{D) < oo. 

Proof. For one direction, note that, by self-adjointness, the transition 
density function p{t,y,y') for the normally reflected Brownian motion is 
symmetric in y and y'; therefore, Jjjp(t,y,y') dy = Jj-,p(t,y' ,y) dy = 1. Thus, 
if Vol(L') < oo, then the constant y^^^^^ is the invariant probability den- 
sity. On the other hand, if there exists an invariant probability density (p, 
then by the spectral theorem and the regularity, (j) must be an eigenfunction 
corresponding to the eigenvalue for — ^A^r; that is, (j) is iA/vr-harmonic: 
^A^cf) = in D and V(f> • n = on dD. The existence of the invariant proba- 
bility measure guarantees recurrence, and it is well known that the generator 
of a recurrent Markov process possesses no nonconstant positive harmonic 
functions [3], Chapter 4; thus, we conclude that (p is constant. But if (p is 
constant and is a probability density on D, then Vol(D) < oo. □ 

With regard to the transience/recurrence dichtomy, the self-adjointness 
no longer acts as a deus ex machina. However, it does allow one to prove 
that this dichotomy exhibits monotonicity with respect to the domain; that 
is, if the normally reflected Brownain motion in D is recurrent, then the 
normally reflected Brownian motion in D is also recurrent \i D d D. The 
proof hinges on a variational formula which we now describe. Let = 
D n {|y| < n}, assume without loss of generality that Di = {\y\ < 1} and let 



A]f^^ = {n G C^iDn - Di) n C{Dn -Di):u = lon dDi and u = on {\y 
n}nD}. Then [2, 3] 



K D C D, then it is easy to see that any u G Aj^ when restricted to the 
appropriate smaller domain, belongs to ^4^'^ . The domain monotonicity 

follows from this and (1.1). 

In particular, the domain monotonicity renders trivial the dichotomy of 
transcience/recurrence when d = 2: since standard Brownian motion in all of 
is recurrent, normally reflected Brownian motion in any domain D d B? 
is a fortiori recurrent. 

For the rest of this paper we will study the transcience/recurrence di- 
chotomy in domains D C R'^, d>3, of the following form. Let H > he a 



(1.1) 




if B{t) is recurrent; 
if B{t) is transient. 
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continuous function on [0,oo). For l,m>l with / + m > 3, denote points 
y G i?'"*"™ by y = {x, z), where x ^ and z G i?™. Let 

(1.2) D = {(x, z) G : \z\ < H{\x\)}. 

We single out two particular subclasses of domains as above. In the case 
that / = 1, we will write d — 1 instead of m, and such domains will be called 
d-dimensional horn-shaped domains. In the case that m = 1, we will write 
d—1 instead of / , and such domains will be called d-dimensional generalized 
slab domains. 

Before presenting the results, we note the following point of departure. In 
consonance with the above notation, denote the normally reflecting Brow- 
nian motion as B{t) = {X{t),Z{t)). Consider the case that H is constant. 
Then D is the product of and a ball in R"^. (In particular, if / = 1, it is 
a cylinder and if m = 1, it is a slab.) Then X{t) in isolation is a standard l- 
dimensional Brownian motion. If / < 2, then it is clear that the recurrence of 
X{t) guarantees the recurrence of B{t). By the domain monotonicity noted 
above, this recurrence will also hold for any domain that is contained in D. 
Thus, for / < 2, the interesting case occurs when H is unbounded. On the 
other hand, if Z > 3, then X{t) is transient and, thus, so is B{t). By domain 
monotonicity, this transience will also hold for any domain containing D. 
Thus, the interesting case occurs when lims_>oo H{s) = 0. 

We will impose the following regularity conditions on H. 

Assumption H. He C^([0,oo)) and satisfies the following condi- 
tions: lims_^oo H{s)H"{.s) = lims_^oo H'{,s) = 0, H{.s)H'{s) = o{s) as s ^ oo, 

r'-^ds<oo, r'-^ds<oo. 

Remark. Assumption H allows for H{s) ^ s"' with 7 < 1 but not with 
7 > 1. However, this growth restriction is in fact irrelevant, as will be noted 
in the remark following the theorem and examples below. 

Theorem 1. Let d = I + m > 3 and let D C i?*^ be the domain defined 
by (1.2) via a function H which satisfies Assumption H. 

(i) // J°° s^^''H~'"^{s) ds = 00 and D D, then normally reflected Brow- 
nian motion in D is recurrent. 

(ii) If /°° s^~^ H'""^ {.s) ds < CO and D ^D, then normally reflected Brow- 
nian motion in D is transient. 

Remark. For a related result in the context of random walks, see [1], 
page 400. 
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Example 1 {Horn-shaped domains). Denote points in R , d > 3, by 
(x, z) with X R and z G R'^~^ . Let D be the d-dimensional horn-shaped do- 
main defined hy D = {{x, z) € R'^ : \z\ < (1 + Then normaUy reflected 
Brownian motion in D is recurrent if 7 < and transient if 7 > . 

Example 2 {Generalized slab domains). Denote points in R'^ , d > 3, by 
{x,z) with X S R'^~^ and z G R. If D is the d-dimensional generahzed slab 
defined by D = {{x,z) G R"^ : \z\ < (1 + Ixl)"^}, then the normahy refiected 
Brownian motion in D is recurrent if 7 < 3 — d and transient if 7 > 3 — d. If 
d = 3 and D is the generahzed slab domain defined hy D = {{x,z) G R'^ : l-^l < 
log'''(2+ |x|)}, then the normally refiected Brownian motion in D is recurrent 
if 7 < 1 and transient if 7 > 1 . 

Example 3. For the domain D = {{x,z) e \z\ < H{\x\)}, with 

H{s) ~ s'^ , the normally refiected Brownian motion is recurrent if 7 < 
and transient if 7 > ^ . 

Remark. Example 3 demonstrates that for any domain D defined by 
(1.2) with H{s) ~ s'^, the value of 7 that represents the cut-off between 
recurrence and transience is never greater than ^. This fact, along with 
the domain monotonicity with regard to transience and recurrence, renders 
irrelevant the growth condition imposed by Assumption H and noted in the 
remark following that assumption. 

We now give the probabilistic intuition for Theorem 1. Consider first an 
(/ + m)-dimensional Brownian motion {X{t),Z{t)) in the cylinder {{x,z) G 
j^l+m . ^ q| -with skew-reflection at |2:| = a corresponding to the reflection 
vector (7|^, where /3 > and 7 are constants and the vector has been 

normalized by the requirement that 7^ + = 1. Let p{t) = \X{t)\. By Ito's 
formula for diffusions with reflection, one has p{t) =W{t) + /q ds + 
^La{t), where W{t) is a one-dimensional Brownian motion and La{t) is the 
local time up to time t of Z{-) at {\z\ = a} [4]. We will show below that 
Ex,zLa{t) ~ as t ^ 00. Thus, over the long run, the local time term 
behaves like a constant drift of strength Consequently, the behavior 
of p{t) = \X{t)\ over the long run should be like the behavior of the one- 
diffusion generated by + ^ ^ + ^ A. 

With the above analysis in mind, consider the normally reflected Brow- 
nian motion in where D is given by (1.2). At a point {x,z) G dD, 
one has \z\ = H{\x\) and the normalized normal reflection vector point- 
ing into D is given by {{H')'^{\x\) + l)~^l'^{H'{\x\)^,-^). Taking our 
cue from the case above with constant skew reflection vector, and letting 
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a = H{\x\) and 7 = ^^jj-,-^^|^|'^||-^^i/2 1 we would expect the behavior of 

over the long run to be like that of the one-dimensional diffusion generated by 

5^ + ^4 + 2H{p){{Wf{p)+iY'^ i- ^'^''''^ assuming that H'{p) ^ 

as p — > CX3, the above diffusion is not much different from the one gener- 
ated byA=i^ + ^^ + ''%H{p) Tp- '^^^ criterion in Theorem 1 is exactly 
the transience/recurrence criterion [3], Chapter 5, for the one-dimensional 
diffusion whose generator is A. 

We now return to show that E^^zLait) ~ as t — > 00. The process Z{t) in 
isolation is a Brownian on the a-ball with normal reflection at the boundary. 
Let £z denote the expectation for this process starting from z. Let 
denote the Laplacian on ii™, let r = \z\ and note that ^A^d^zp) = iti and 



\z\=a = 2a. Let cr,. = inf{t > 0: = r} and let Zr denote a point 

satisfying \zr \ = r. We now twice apply Ito's formula for diffusions with 
reflection to the process Z{t) and the function |zp and take expectations. 
One time we start at Za/2 and terminate at aa, and the other time we start 
at Za and terminate at aa/2- We obtain 



and 



a' 



■£za\Z{cra/2)\ =« +'^^-yg mdt-2a£zaLa{(ya/2) 



4 

+ m£z^Oa/2 - '^a£zaLa{cra/2) 



Of course, we also have £z^/2^a{^a) = since La{t) = for t < aa- From the 
above equations we obtain 

£z^/2La{cFa) + £z^La{aa/2) _ 771 
£z^/2^a.+£za(^a/2 2a 

Thus, ^ is equal to the expected local time accrued by Z{t) at {\z\ = a} 
over a complete cycle starting at = § and ending again at l^l = § after 
reaching |z| = a divided by the expected total time of such a complete cycle. 
Using this, it follows easily from the renewal theorem that Ex^zLa{t) ~ -^t 
as t ^ oo. 

The rest of the paper is organized as follows. In Section 2 we construct 
a class of functions from which we will cull appropriate Lyapunov functions 
which will be used to prove Theorem 1. Then in Section 3 we give the proof 
of Theorem 1. 
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2. Lyapunov functions. In this section we construct a family of functions 
from which we wih cuh appropriate Lyapunov functions which will be used to 
prove Theorem 1. Let D be a domain in i?'^'" defined by (1.2) for some choice 
of H satisfying Assumption H. Recall that we are writing points in R^~^"^ by 
(x, z), where x € i?' and z G R"^. Let p = \x\ and r = \z\. The functions we 
construct will be functions of p and r and will denoted by u{p,r). Each such 
function u will depend on a function /, which is an arbitrary C^-function 
from [0, oo) to (0, oo). For such an /, we define u by 

(2.1) u(^-^^r' + s + ^H{s)H\s),r^=f{s), 0<r<H{s). 

Assumption H guarantees that, for sufficiently large s, the first argument 
in u above is increasing in s for each fixed r G [0,H{s)]. Thus, u is well 
defined by (2.1) for all sufficiently large s and r < H{s). In particular then, 
for some po > 0, u is well defined on D D {\x\ > po} . Note that for each fixed 
s, the argument of u in (2.1) defines a paraboloid with independent variable 
r = \z\. These paraboloids are the level sets of u. Note that they have been 
chosen so that 

(2.2) (Vn-n)(x,z) = for {x, z) e dD n {\x\ > po}, 

where n is the unit inward normal at dD. 

We now calculate ^An. Since u depends only on p = \x\ and r = \z\, we 
have 

, , 1 ^ 1 l-l 1 m-1 

(2.3 -Au=-Ur,o-\ Ur,-\ Urr -\ Ur- 

^ ^ 2 2 '^'^ 2p 2 2r 

In the calculations that follow, we simplify notation by defining 
L{s) = logH{s) and Q{s) = H^is). 

Also, we suppress the argument {—^^jjjp^^"^ + s + ^H{s)H'{s),r) that ap- 
pears in u and its derivatives. Differentiating (2.1) with respect to r gives 

(2.4) -rL'{s)up + Ur = 

and differentiating a second time with respect to r gives 

(2.5) r'^{L' {s))'^Upp — L'{s)up + Urr — 2rL'{s)upr = 0. 
Differentiating (2.1) with respect to s gives 

(2.6) {-\r^L"{s) + 1 + \Q"{s))up = /'{s) 
and differentiating a second time with respect to s gives 

(2.7) i-yL"is) + 1 + kQ"is))\p + i-yL"'is) + lQ"'is))up = f"{s). 
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Differentiating (2.4) with respect to s gives 
{-yL"{s) + l + lQ"{s))u^ 

(2.8) 

- rL'{s){-yL"{s) + 1 + lQ"{s))u,, - rL"{s)up = 0. 

Equation (2.4) allows one to solve for Ur in terms of Up and L. Equation 
(2.8) allows one to solve for Upr in terms of Upp,Up,L and Q, and then (2.5) 
allows one to solve for Urr in terms of these same functions. Equation (2.6) 
allows one to solve for Up in terms of f,L and Q, and then (2.7) allows one 
to solve for Upp in terms of these same functions. We are therefore able to 
express ^Au as given in (2.3) in terms of f,L and Q as follows: 



^" l{^n)(-l^r' + s+lH{s)H\s),r 



(2.9) 



where 



2 2' 'V 2 H{s) 2 

]^A{T,s)f"{s) + \B{r,s)r{s) 



, ^ X l+r2(L'(s))^ 

(2.10) A{r,s) = - ^ ^ " 



and 



C2 



, , Vis) „ , 1 2r'^L'L" 



(2.11) 



C ' 'C jC C2 
' ■ {l + r'^{L'{s)f){dC/ds) 

with 

(2.12) C = C(r, s) = l + \Q"{s) - yL"{s) 
and 

(2.13) Jc=^Jcyr,s) = s + \q'{s) - lr'L'{s). 

We note that, by the assumptions on H, C{r, s) and (/ C)((r, s) are bounded 
away from for large s and r < H(s). 



3. Proof of Theorem 1. It suffices to prove the results for D as in the 

statement of the theorem. The corresponding results for D then follow from 
the domain monotonicity property noted in Section 1. Recall that we are 
writing the normally reflected Brownian motion as B{t) = {X(t),Z{t)). For 
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xq > 0, let = inf{t > 0: X{t) < xq}. For a C^-function v defined on D n 
{x >xq}, Ito's formula gives 

(3.1) =v{B{0))+ {Vv){B{s))dW{s) 





+ / -{Av){B{s))ds+ {Vvn){B{s))dL{s), 
Jo ^ Jo 

where is a standard (i-dimensional Brownian motion, n is the inward unit 
normal at dD and L is the local time of B(t) at the boundary dD. If Vv ■ n = 
on dD n {x > xq}, then the local time term vanishes. If one can find such 
a V for which ^ on D n \^x ^ xq} and such that lim^:— ►oo 

v{x, z) = oo, 

then the normally reflected Brownian motion is recurrent, while if one can 
find such a bounded v for which Av < on D D {x > xq} and such that 
v{xi,z) < inf|^|<j|/(2,'o) ^^(^^Oi-^), for some xi > xq, then the normally reflected 
Brownian motion is transient [3], Chapter 6. 

Recall from (2.2) that the function u defined in (2.1) satisfies Vu ■ n = 
on dD Ci {\x\ > po} . If one can choose the function / appearing in the 
definition of u such that lims^oo f{s) = oo and ^Au{x, z) < 0, for (x, z) ^ D 
with X sufficiently large, then one can choose v = u and conclude that the 
normally reflected Brownian motion is recurrent. Alternatively, if one can 
choose a bounded, increasing / such that ^Au{x, z) >0 for (x, z) E D, with x 
sufficiently large, then one can choose v = —u and conclude that the normally 
reflected Brownian motion is transient. 

From (2.9) it follows that if r+(s),r-(s) satisfy 

(3.2) r+(s)> sup ^ir,s), T-{s)< jnf -|(r,s) 

r<His) ^ r<H(s) A 

and if we let 

(3.3) /±(s)= r dte^J- f'r^{p)dp 

Jso \ Jso 

for some sq > 0, then ^Au < if tt is constructed from /"•", and ^Au > if 
u is constructed from /~. Thus, if one can choose r+ so that lim^^oo f{s) = 
oo, then one will obtain recurrence, while if one can choose F" so that 
/~ is bounded, then one will obtain transience. The assumptions on H 
guarantee that, in the calculations that follow below, the denominators of 
all the fractions as well as the numerators of the fractions that appear as 
arguments of logarithms are bounded away from for s sufficiently large. 
We choose sq above sufficiently large to accommodate this condition. 
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In order to choose appropriately, we must analyze ^ from (2.10) and 
(2.11). After performing some algebra to isolate terms that do not depend 
on r, and arranging certain other terms as logarithmic derivatives, we obtain 



A' ' ' ' ' ' ' s + l/4Q'(s)-l/2r2L'(s) 

t\L\s))\\^\I\Q\s)) 



+ \mL\s)Q'\s) 



(3.4) 



+ 



l + r2(L'(s))2 

~ l + r2(L'(s))2 

(l + l/4Q"(s)-l/2r2L"(s))' 
~ l + l/4Q"(s)-l/2r2L"(s) 

I - 1 r2(L^(g))2(l + l/4Q^^(g) - l/2r2L^^(g)) 
2 s + l/4Q'(s)-l/2r2L'(s) ' 

where the prime denotes differentiation with respect to s. For fixed s, as 
functions of r G [0,iJ(s)], the three functions ^^i^r^J^g^yi = f+^^jl7^^' 

(l+l/4Q"(s)-l/2r^L"(s))' _ l/4Q"'(s)-l/2r^L'"(s) , (s+l/4Q'(s)-l/2r^L'(g))' _ 
l+l/4Q"(s)-l/2r^L"(s) ~ l+l/4Q"(s)-l/2r^L"(s) s+l/4Q'(s)-l/2HL'(s) " 

'^s+l^AQ' (s j - i/2r^ L' (ff take on their maximum values and their minimum val- 
ues at the endpoints {0, if(s)}. In particular then, the functions 

(l + r2(L'(s))2)' 



(3.5) 



(3.6) 



and 



(3.7) 



E'^{s) = sup 

0<r-<_fi 

£'-(s) = _inf 
F'^{s) = sup 

0<r<H{s) 



F-(s)= inf 

0<r<H(s) 



0<r<His) l+r2(L'(s))2 ' 

.^^ (l + r2(L-(,))2)^ 

0<r<H(s) l + r2(L'(s))2 ' 

(l + l/4g"(s)-l/2r2L"(s))' 



G~^{s) = sup 



G-{s) = inf 



i + i/4g"(s) 


- l/2r2L"(s) 


(i + i/4g"(s) 


- l/2r2L"(s))' 


l + l/4Q"(s) 


-l/2r2L"(s) 


(s + l/4Q'(s)- 


-l/2r2L'(s))' 


s + l/4Q'(s) 


-l/2r2L'(s) ' 


(s + l/4Q'(s)- 


-l/2r2L'(s))' 



o<r<His) s + l/4Q'(s) - l/2r2L'(s) 
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are continuous and piecewise continuously differentiable, and 

r2 l + \(T'(+\\2 



(3.8) 



Jso ^ l + l/^Q"{t)-l/2Hla){U>{t)Y ' 



5o + l/4Q'(so)-l/2i/2^(5o)L'(so)' 

where if,±(s) G {0,i?(s)}, for *=E,F,G. 



Since L' = Q" = 2HH" + 2(i?')^ and < r < iJ, it follows from As- 
sumption H that, for some Cq > 0, one has 



^ l+r2(L'(.))2 ^ 

Similarly, for some Ci > 0, one has 

/ - 1 r^(L-(g))^|l + l/AQ"{s) - l/2r^L"{s)\ ^ {H'{s))' 
^ ■ ^ 2 .s + l/4Q'(s)-l/2r2L'(s) " ^ s ' 

In light of the above analysis, we define 

(s) = mL [s) + -ml [s)Q [s) + Co + Ci 

+ ^i^+(.) + F+(.) + (Z-l)G+(.); 

(3.11) 

r"(.) = mL'(s) + jmL'{s)Q"{s) - Co^^^ - C^^-^^^ 

+ ^i?-(.) + F-(.) + (Z-l)G-(.). 

These choices of satisfy (3.2). We define as in (3.3). 

It remains to analyze the behavior of f^ass—^ oo. By (3.8) and the as- 
sumptions on H, exp(— J^^{^^^ (p) + {p)) dp) is bounded and bounded 

from for large t. By the assumptions on H, exp(ib ^0 ^^H{pj '^P) 

exp(± Ci^^-jp^ dp) are bounded and bounded from for large t. We 
have 

£ L'{p)Q"{p) dp = 2£ [h'{p)H"{p) + dp 

= {H'{t)f - {H'{so)f + j^^ ^-jf{p)dp 



\H'{s 
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and, thus, by the assumptions on H, exp(— ^ j^^ L'{p)Q"{p) dp) is bounded 
and bounded from for large t. 

The assumptions on H also show that 

so so + l/4Q'(so) - (so)L'(so) so 

(3.12) 

where < c(so) = o(l) as sq oo. 

Thus, from (3.8) one has 

-(l + c(so))A^-' (K, ,^^±,„^, \//(l-c(.o))t^^-^ 



(3.13) 

Finally, we have 

exp^— y mL'{p)dp 



<exp(^-y (/-l)G±(p)dp) < 



So J \ JsQ J \ Sq 

where < c(so) = o(l) as so — > oo. 



m 

H{so) 



The calculations of the last two paragraphs along with (3.11) give 
(3.14) <(l + C(so))^'^'^'^^^*^ 



So/ \H{so) 

where < C(so) = o(l) as so — oo- 

We therefore conclude from (3.3) and (3.14) that limg^oo /"^(s) = oo, if 
joc ^i-i-^-m^^-^ ^ J- -g bounded, if /~ t^-^H-'^{t) dt < oo. 
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